Pratham Jain's profile

AI,AR VR GLOVES FOR DEAFBLIND (GRADUATION THESIS)

Our project unleashes a triad of revolutionary wearables, creating a new reality for the DeafBlind community and transforming the way we interact with the world.


PRODUCT 1-
Force Feedback Gloves: Advanced haptic technology forms the core of these gloves, providing tactile sensations that break down the walls between the physical and virtual. Through electrostatic brakes, users feel virtual shapes, enabling them to engage with the digital sphere like never before.

PRODUCT 2-
Real-Time Translation Gloves: These gloves are a game-changer in communication, providing real-time translations of spoken language, sign language gestures, and written text. AI-driven technology alongside customizable haptic feedback patterns, text-to-speech tech, and speech ensures the gloves adapt to user's communication preferences.

PRODUCT 3-
3D Environment Mapping Device: This device is your personal guide, equipped with a camera, LIDAR, and advanced sensors for 3D mapping. Providing personalized audio and vibrations, it helps users navigate their surroundings, fostering an enriched engagement with the world.

The vision is a seamless system: Camera-equipped devices map 3D environments, uploading scans to an open-source AI which optimizes them for DeafBlind haptic feedback. Barcoded posters enable product scanning, and our gloves convert any language into haptic braille - all touch-free. From education to 3D art creation, our wearables open up a world of possibilities. It's not just a product line; it's a paradigm shift in accessibility and employment opportunities.
THOUGHT BEHIND THE ENVIRONMENT
Amidst a symphony of tactile wonders, geometry and abstraction merge. Textures become storytellers, while abstract shapes breathe life. Here, in this sensory world , DeafBlind hearts find peace and inspiration.
Force Feedback Gloves: Advanced haptic technology forms the core of these gloves, providing tactile sensations that break down the walls between the physical and virtual. Through electrostatic brakes, users feel virtual shapes, enabling them to engage with the digital sphere like never before.
HELPS DEAFBLIND PEOPLE FEEL SHAPES VIRTUALLY
WIREFRAME
SOLID
METAL
PREVIEW
RENDERED
USED SERVO MOTORS TO ACT AS FINGER BRAKE WITH HELP OF STRING
POTENTIOMETER TRACKS FINGER MOVEMENT 
HANDS TO EXPLORE THE WORLD INDEPENDENTALY
PRODUCT 2 
REAL TIME TRANSLATION GLOVES 
( ANY LANGUAGE TO HAPTIC FINGER BRAILLE AND VICE VERSA)
THIS PRODUCT PROVIDES DEAFBLIND WITH NO TOUCH LIMITLESS SEAMLESS COMMUNICATION WITH ANYONE IN THIS WORLD
VOICE AND EARS FOR THE DEAFNESS
Real-Time Translation Gloves: These gloves are a game-changer in communication, providing real-time translations of spoken language, sign language gestures, and written text. AI-driven technology alongside customizable haptic feedback patterns, text-to-speech tech, and speech ensures the gloves adapt to user's communication preferences.
PRODUCT 3 
3D ENVIRONMENT MAPPING AI COMPUTER VISION OPTIMISED TOOL
THIS PRODUCT SCANS ENVIRONMENT IN 3D, HAS BUILT IN SPEAKER FOR A PERSONALISED VOICE OF THE DEAFBLINDS, ALSO READS SIGN LANGUAGES,FINGERSPELLING AND MANY MORE.
EYES FOR THE BLINDNESS
3D Environment Mapping Device: This device is your personal guide, equipped with a camera, LIDAR, and advanced sensors for 3D mapping. Providing personalized audio and vibrations, it helps users navigate their surroundings, fostering an enriched engagement with the world.
Within my design, I have incorporated tactile elements that engage the sense of touch. These intentional touches create an interactive and enriching experience for DeafBlind users, allowing them to explore and interact with the product through a captivating tactile interface. LIKE THE COLOR, MATERIAL AND THE FINISH
SENSORS USED IN THIS
Camera sensor, LIDAR sensor, IMU sensor, computer or processor, speaker, microphone, temperature sensor, proximity sensor.
SYSTEM ARCHITECTURE
Our system initiates a new era of accessibility and interaction through a seamless synergy of state-of-the-art technologies:

(STEP 1) Data Acquisition: Devices outfitted with state-of-the-art cameras, LIDAR, and sensors gather detailed 3D environmental data. Engaged individuals, NGOs, and everyday users capture the richness of the physical world, laying the foundation for an inclusive digital landscape.

(STEP 2) Data Compilation: All captured data funnels into a secure, cloud-based storage system, creating a vast repository of 3D scans. This database functions as the backbone of our system, ready for intelligent processing and usage.

(STEP 3) Intelligent Processing: The wealth of 3D data is then processed on our AI platform. Advanced machine learning algorithms curate and optimize these scans for haptic and force feedback compatibility, setting the stage for a unique experience for the DeafBlind community.

(STEP 4) Interface Translation: Our innovative real-time translation gloves come into play in the physical world. When users scan barcoded posters serving as gateways, these smart wearables convert any language into touch-free haptic braille, creating a universal mode of communication.

(STEP 5) Personalized User Profiles: The system learns from every interaction, curating personalized user profiles that adjust and enhance the experience. Customization empowers users to have control over their interactions, ensuring a comfortable and engaging journey.

(STEP 6) Immersive Interaction: Finally, equipped with our force feedback gloves, users 'feel' the digitized world. The gloves provide an avenue for users to explore their surroundings, create 3D art, engage in learning, and immerse in a world of digital possibilities.

(STEP 7) Community Building: Through shared experiences and interaction, a supportive and inclusive digital community is born. Users, contributors, and supporters engage, learn, and grow together, fostering a sense of belonging and collective growth.

This system not only revolutionizes accessibility for the DeafBlind community but also pioneers a paradigm shift in digital interactivity, inclusive learning, and diverse employment opportunities. It's a bold leap towards a touch-free, barrier-free world with limitless possibilities.
AI,AR VR GLOVES FOR DEAFBLIND (GRADUATION THESIS)
Published:

Owner

AI,AR VR GLOVES FOR DEAFBLIND (GRADUATION THESIS)

Published: